Hearing lips: gamma-band activity during audiovisual speech perception.

نویسندگان

  • Jochen Kaiser
  • Ingo Hertrich
  • Hermann Ackermann
  • Klaus Mathiak
  • Werner Lutzenberger
چکیده

Auditory pattern changes have been shown to elicit increases in magnetoencephalographic gamma-band activity (GBA) over left inferior frontal cortex, forming part of the putative auditory ventral "what" processing stream. The present study employed a McGurk-type paradigm to assess whether GBA would be associated with subjectively perceived changes even when auditory stimuli remain unchanged. Magnetoencephalograms were recorded in 16 human subjects during audiovisual mismatch perception. Both infrequent visual (auditory /ta/ + visual /pa/) and acoustic deviants (auditory/pa/ + visual /ta/) were compared with frequent audiovisual standards (auditory /ta/ and visual /ta/). Statistical probability mapping revealed spectral amplitude increases at approximately 75 and approximately 78 Hz to visual deviants. GBA to visual deviants peaked 160 ms after auditory stimulus onset over posterior parietal cortex, at 270 ms over occipital areas and at 320 ms over left inferior frontal cortex. The latter GBA enhancement was consistent with the increase observed previously to pure acoustic mismatch, supporting a role of left inferior frontal cortex for the representation of perceived auditory pattern change. The preceding gamma-band changes over posterior areas may reflect processing of incongruent lip movements in visual motion areas and back-projections to earlier visual cortex.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Early and late beta-band power reflect audiovisual perception in the McGurk illusion.

The McGurk illusion is a prominent example of audiovisual speech perception and the influence that visual stimuli can have on auditory perception. In this illusion, a visual speech stimulus influences the perception of an incongruent auditory stimulus, resulting in a fused novel percept. In this high-density electroencephalography (EEG) study, we were interested in the neural signatures of the ...

متن کامل

Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception.

Observing a speaker's mouth profoundly influences speech perception. For example, listeners perceive an "illusory" "ta" when the video of a face producing /ka/ is dubbed onto an audio /pa/. Here, we show how cortical areas supporting speech production mediate this illusory percept and audiovisual (AV) speech perception more generally. Specifically, cortical activity during AV speech perception ...

متن کامل

Teaching and learning guide for audiovisual speech perception: A new approach and implications for clinical populations

When a speaker talks, the visible consequences of what they are saying can be seen. This auditory (the speech sound) and visual (movements of the lips and other articulators), or AV speech influences what listeners hear both in noisy listening environments and when auditory speech can easily be heard. Thought to be a cross‐cultural phenomenon that emerges early in typical language development, ...

متن کامل

Early and Late Beta Band Power reflect Audiovisual Perception in 1 the McGurk Illusion

33 The McGurk illusion is a prominent example of audiovisual speech perception and the influence, visual 34 stimuli can have on auditory perception. In this illusion a visual speech stimulus influences the 35 perception of an incongruent auditory stimulus resulting in a fused novel percept. In this high-density 36 electroencephalography (EEG) study we were interested in the neural signatures of...

متن کامل

Can you "read tongue movements"?

Lip reading relies on visible articulators to ease audiovisual speech understanding. However, lips and face alone provide very incomplete phonetic information: the tongue, that is generally not entirely seen, carries an important part of the articulatory information not accessible through lip reading. The question was thus whether the direct and full vision of the tongue allows tongue reading. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Cerebral cortex

دوره 15 5  شماره 

صفحات  -

تاریخ انتشار 2005